Benchmarking Econometric and Machine Learning Methodologies in Nowcasting

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting

The goal of precipitation nowcasting is to predict the future rainfall intensity in a local region over a relatively short period of time. Very few previous studies have examined this crucial and challenging weather forecasting problem from the machine learning perspective. In this paper, we formulate precipitation nowcasting as a spatiotemporal sequence forecasting problem in which both the in...

Application of Machine Learning Classifiers and Regularization in Econometric Theory

As machine learning techniques become more popular and computers become capable of storing and processing large quantities of data, there have been many recent efforts to incorporate such techniques into structural econometric models. My research aims to extend this literature by introducing the techniques of regularization and classification (from machine learning) into Generalized Method of M...

Benchmarking Apache Spark with Machine Learning Applications

We benchmarked Apache Spark with a popular parallel machine learning training application, Distributed Stochastic Gradient Descent for Matrix Factorization [5] and compared the Spark implementation with alternative approaches for communicating model parameters, such as scheduled pipelining using POSIX socket or MPI, and distributed shared memory (e.g. parameter server [13]). We found that Spark...

Methodologies from Machine Learning in Data Analysis and Software

In the last few decades the rise of computing and telecommunications has flooded the worlds of government, business, medicine and engineering with unprecedented volumes of stored data. These databases provide the raw material for information supply but have been largely impenetrable as potential sources of expert knowledge. Computer-oriented techniques can now be used, however, in integration w...

Revisiting Benchmarking Principles and Methodologies for Big Data Benchmarking